Deep Adaptive Attention for Joint Facial Action Unit Detection and Face Alignment

Facial action unit (AU) detection and face alignment are two highly correlated tasks since facial landmarks can provide precise AU locations to facilitate the extraction of meaningful local features for AU detection. Most existing AU detection works often treat face alignment as a preprocessing and handle the two tasks independently. In this paper, we propose a novel end-to-end deep learning framework for joint AU detection and face alignment, which has not been explored before. In particular, multi-scale shared features are learned firstly, and high-level features of face alignment are fed into AU detection. Moreover, to extract precise local features, we propose an adaptive attention learning module to refine the attention map of each AU adaptively. Finally, the assembled local features are integrated with face alignment features and global features for AU detection. Experiments on BP4D and DISFA benchmarks demonstrate that our framework significantly outperforms the state-of-the-art methods for AU detection.Comment: This paper has been accepted by ECCV 201

Space-efficient Feature Maps for String Alignment Kernels

String kernels are attractive data analysis tools for analyzing string data. Among them, alignment kernels are known for their high prediction accuracies in string classifications when tested in combination with SVM in various applications. However, alignment kernels have a crucial drawback in that they scale poorly due to their quadratic computation complexity in the number of input strings, which limits large-scale applications in practice. We address this need by presenting the first approximation for string alignment kernels, which we call space-efficient feature maps for edit distance with moves (SFMEDM), by leveraging a metric embedding named edit sensitive parsing (ESP) and feature maps (FMs) of random Fourier features (RFFs) for large-scale string analyses. The original FMs for RFFs consume a huge amount of memory proportional to the dimension d of input vectors and the dimension D of output vectors, which prohibits its large-scale applications. We present novel space-efficient feature maps (SFMs) of RFFs for a space reduction from O(dD) of the original FMs to O(d) of SFMs with a theoretical guarantee with respect to concentration bounds. We experimentally test SFMEDM on its ability to learn SVM for large-scale string classifications with various massive string data, and we demonstrate the superior performance of SFMEDM with respect to prediction accuracy, scalability and computation efficiency.Comment: Full version for ICDM'19 pape

In vitro Antioxidant of a Water-Soluble Polysaccharide from Dendrobium fimhriatum Hook.var.oculatum Hook

A water-soluble crude polysaccharide (DFHP) obtained from the aqueous extracts of the stem of Dendrobium fimhriatum Hook.var.oculatum Hook through hot water extraction followed by ethanol precipitation, was found to have an average molecular weight (Mw) of about 209.3 kDa. Monosaccharide analysis revealed that DFHP was composed of mannose, glucose and galactose in a content ratio of 37.52%; 43.16%; 19.32%. The investigation of antioxidant activity in vitro showed that DFHP is a potential antioxidant

Associations between use of macrolide antibiotics during pregnancy and adverse child outcomes: A systematic review and meta-analysis

BACKGROUND: Evidence on adverse effects of maternal macrolide use during pregnancy is inconsistent. We conducted a systematic review and meta-analysis to investigate the association between macrolide use during pregnancy and adverse fetal and child outcomes. METHODS AND FINDINGS: We included observational studies and randomised controlled trials (RCTs) that recorded macrolide use during pregnancy and child outcomes. We prioritized comparisons of macrolides with alternative antibiotics (mainly penicillins or cephalosporins) for comparability of indication and effect. Random effects meta-analysis was used to derive pooled odds ratios (OR) for each outcome. Subgroup analyses were performed according to specific types (generic forms) of macrolide. Of 11,186 citations identified, 19 (10 observational, 9 RCTs) studies were included (21 articles including 228,556 participants). Macrolide prescribing during pregnancy was associated with an increased risk of miscarriage (pooled ORobs 1·82, 95% CI 1·57-2·11, three studies, I2 = 0%), cerebral palsy and/or epilepsy (ORobs 1·78, 1·18-2·69; one study), epilepsy alone (ORobs 2·02, 1·30-3·14, one study; ORRCT 1.03, 0.79-1.35, two studies), and gastrointestinal malformations (ORobs 1·56, 1·05-2·32, two studies) compared with alternative antibiotics. We found no evidence of an adverse effect on 12 other malformations, stillbirth, or neonatal death. Results were robust to excluding studies with high risk of bias. CONCLUSIONS: Consistent evidence of an increased risk of miscarriage in observational studies and uncertain risks of cerebral palsy and epilepsy warrant cautious use of macrolide in pregnancy with warnings in drug safety leaflets and use of alternative antibiotics where appropriate. As macrolides are the third most commonly used class of antibiotics, it is important to confirm these results with high quality studies

Relation Modeling with Graph Convolutional Networks for Facial Action Unit Detection

Most existing AU detection works considering AU relationships are relying on probabilistic graphical models with manually extracted features. This paper proposes an end-to-end deep learning framework for facial AU detection with graph convolutional network (GCN) for AU relation modeling, which has not been explored before. In particular, AU related regions are extracted firstly, latent representations full of AU information are learned through an auto-encoder. Moreover, each latent representation vector is feed into GCN as a node, the connection mode of GCN is determined based on the relationships of AUs. Finally, the assembled features updated through GCN are concatenated for AU detection. Extensive experiments on BP4D and DISFA benchmarks demonstrate that our framework significantly outperforms the state-of-the-art methods for facial AU detection. The proposed framework is also validated through a series of ablation studies.Comment: Accepted by MMM202

Learning image quality assessment by reinforcing task amenable data selection

In this paper, we consider a type of image quality assessment as a task-specific measurement, which can be used to select images that are more amenable to a given target task, such as image classification or segmentation. We propose to train simultaneously two neural networks for image selection and a target task using reinforcement learning. A controller network learns an image selection policy by maximising an accumulated reward based on the target task performance on the controller-selected validation set, whilst the target task predictor is optimised using the training set. The trained controller is therefore able to reject those images that lead to poor accuracy in the target task. In this work, we show that the controller-predicted image quality can be significantly different from the task-specific image quality labels that are manually defined by humans. Furthermore, we demonstrate that it is possible to learn effective image quality assessment without using a ``clean'' validation set, thereby avoiding the requirement for human labelling of images with respect to their amenability for the task. Using $6712$, labelled and segmented, clinical ultrasound images from $259$ patients, experimental results on holdout data show that the proposed image quality assessment achieved a mean classification accuracy of $0.94\pm0.01$ and a mean segmentation Dice of $0.89\pm0.02$, by discarding $5\%$ and $15\%$ of the acquired images, respectively. The significantly improved performance was observed for both tested tasks, compared with the respective $0.90\pm0.01$ and $0.82\pm0.02$ from networks without considering task amenability. This enables image quality feedback during real-time ultrasound acquisition among many other medical imaging applications

Hierarchical semantic representations of online news comments for emotion tagging using multiple information sources

With the development of online news services, users now can actively respond to online news by expressing subjective emotions, which can help us understand the predilections and opinions of an individual user, and help news publishers to provide more relevant services. Neural network methods have achieved promising results, but still have challenges in the field of emotion tagging. Firstly, these methods regard the whole document as a stream or bag of words and can't encode the intrinsic relations between sentences. So these methods cannot properly express the semantic meaning of the document in which sentences may have logical relations. Secondly, these methods only use semantics of the document itself, while ignoring the accompanying information sources, which can significantly influence the interpretation of the sentiment contained in documents. Therefore, this paper presents a hierarchical semantic representation model of news comments using multiple information sources, called Hierarchical Semantic Neural Network (HSNN). In particular, we begin with a novel neural network model to learn document representation in a bottom-up way, capturing not only the semantics within sentence but also semantics or logical relations between sentences. On top of this, we tackle the task of predicting emotions for online news comments by exploiting multiple information sources including the content of comments, the content of news articles, and the user-generated emotion votes. A series of experiments and tests on real-world datasets have demonstrated the effectiveness of our proposed approach

Low Resistance Polycrystalline Diamond Thin Films Deposited by Hot Filament Chemical Vapour Deposition

Polycrystalline diamond thin films with outgrowing diamond (OGD) grains were deposited onto silicon wafers using a hydrocarbon gas (CH4) highly diluted with H2 at low pressure in a hot filament chemical vapour deposition (HFCVD) reactor with a range of gas flow rates. X-ray diffraction (XRD) and SEM showed polycrystalline diamond structure with a random orientation. Polycrystalline diamond films with various textures were grown and (111) facets were dominant with sharp grain boundaries. Outgrowth was observed in flowerish character at high gas flow rates. Isolated single crystals with little openings appeared at various stages at low gas flow rates. Thus, changing gas flow rates had a beneficial influence on the grain size, growth rate and electrical resistivity. CVD diamond films gave an excellent performance for medium film thickness with relatively low electrical resistivity and making them potentially useful in many industrial applications

The Inhomogeneous Ionizing Background Following Reionization

We study the spatial fluctuations in the hydrogen ionizing background in the epoch following reionization (z ~ 5--6). The rapid decrease with redshift in the photon mean free path (m.f.p.), combined with the clustering of increasingly rare ionizing sources, can result in a very inhomogenous ionizing background during this epoch. We systematically investigate the probability density functions (PDFs) and power spectra of ionizing flux, by varying several parameters such as the m.f.p., minimum halo mass capable of hosting stars, and halo duty cycle. In order to be versatile, we make use of analytic, semi-numeric and numeric approaches. Our models show that the ionizing background indeed has sizable fluctuations during this epoch sourced by the clustering of sources, with the PDFs being a factor of few wide at half of the maximum likelihood. The distributions also show marked asymmetries, with a high-value tail set by clustering on small scales, and a shorter low-value tail which is set by the mean free path. The power spectrum of the ionizing background is much more sensitive to source properties than the PDF and can be well-understood analytically with a framework similar to the halo model (usually used to describe dark matter clustering). Nevertheless, we find that Lya forest spectra are extremely insensitive to the details of the UVB, despite marked differences in the PDFs and power spectra of our various ionizing backgrounds. Assuming a uniform ionizing background only underestimates the value of the mean ionization rate inferred from the Lya forest by a few percent. Instead, analysis of the Lya forest is dominated by the uncertainties in the density field. Thus, our results justify the common assumption of a uniform ionizing background in Lya forest analysis even during this epoch.Comment: 11 pages, 11 figures, submitted to the MNRA